Online Searching with Turn Cost 



(N 



Erik D. Demaine 

Computer Science and Artificial Intelligence Laboratory 

MIT 

Cambridge MA, USA 

lO ! edemaine^mit . edu 

O 

O ■ Sandor P. Fekete Shmuel Gal 

Department of Mathematical Optimization Department of Statistics 

c^ I Braunschweig University of Technology University of Haifa 

Braunschweig, Germany Haifa, Israel 

sandor . f ekete@tu-bs . de sgalOuniv . half a . ac . il 

^ ! Abstract 

^~J [ We consider the problem of searching for an object on a line at an unknown distance OPT from 

C/3 . the original position of the searcher, in the presence of a cost of d for each time the searcher changes 

direction. This is a generalization of the well-studied linear-search problem. We describe a strategy that 
is guaranteed to find the object at a cost of at most 9 • OPT -I- 2d, which has the optimal competitive 

fT^ ' ratio 9 with respect to OPT plus the minimum corresponding additive term. Our argument for upper 

^ ' and lower bound uses an infinite linear program, which we solve by experimental solution of an infinite 

l/^ , series of approximating finite linear programs, estimating the limits, and solving the resulting recurrences 

\l ' for an explicit proof of optimality. We feel that this technique is interesting in its own right and should 

help solve other searching problems. In particular, we consider the star search or cow-path problem with 
turn cost, where the hidden object is placed on one of m rays emanating from the original position of 



o 



o 

t:J" . the searcher. For this problem we give a tight bound of [1 + 2 , ^^-i ) OPT + ml ( -^^j ) — 1 J d. 

We also discuss tradeoff between the corresponding coefficients and we consider randomized strategies 
5^ ' on the line. 
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1 Introduction 

1.1 Search games 

Searching for an object is one of the fundamental issues of everyday life, and also one of the basic algorithmic 
problems that need to be mastered in the context of computing [201 ■ If the object is located in a bounded 
domain (say, in one of n discrete locations), then the worst-case complexity is obvious: In accordance with 
our everyday experience, an imaginary "hider" may have placed the object in the very last place where we 
look for it. 

More challenging is the scenario of searching in an unbounded domain. The classic prototype is the linear- 
search problem, which was first proposed by Bellman 8 and, independently, by Beck|^: An (immobile) 
object is located on the real line according to a known probability distribution. A searcher, whose maximum 



velocity is one, starts from the origin O and wislies to discover the object in minimum expected time. It 
is assumed that the searcher can change the direction of her motion without any loss of time. It is also 
assumed that the searcher cannot see the object until she actually reaches the point at which the object is 
located; the time elapsed until this moment is the cost function. Originally, the problem was presented in 
a Bayesian context, assuming that the location of the object is given by a known probability distribution 
F^ but what can we do if we do not know Fl This situation is quite common and a natural approach for 
dealing with it is to try to find search trajectories that will be effective against all possible distributions. 
Can such "universal" trajectories be found? 

For this purpose, it is useful to consider a game between a "searcher" S and a "hider" H. As the time 
necessary for the searcher to locate the object may be arbitrarily high (as the object may be hidden far 
from the origin), a useful measure for the performance of a search strategy is the competitive ratio: This 
is the supremum of the ratio between the time the searcher actually travels and the time she would have 
taken if she had known the hiding place. The competitive ratio is a standard notion in the context of online 
algorithms; see ^j E] for recent overviews. As the supremum has to be taken over all possible events of a 
game (or all possible sequences of events in the case of an online problem) , it is quite useful to imagine these 
events chosen by a powerful adversary, who knows the strategy of the searcher. We will focus on a resulting 
primal-dual modeling further down. 

For the linear-search problem, the optimal competitive ratio is 9, as was first shown by Beck and Newman 
[7]: The searcher should alternate between going to the right and to the left, at each iteration doubling her 
step size. By placing the object at one of the points just beyond a turning point of the searcher, the hider 
can actually assure that this ratio of 9 is best possible. 

The linear-search problem has been rediscovered, re-solved, and generalized independently by a number 
of researchers. One such generalization is the star search (first solved by Gal 2SI)i where the searcher has to 
locate the object on one of m rays emanating from the origin; thus, the linear-search problem is a special case 
for m — 2. See 0IE] for a rediscovery and some extensions, as well as [2H1- More recent results and references 
can be found in |29| , which computes the optimal solution including lower-order terms as a function of the 
distance OPT to the object, which need not be known to the robot to obtain optimal behavior including 
these terms. 

1.2 Geometric trajectories and turn cost 

One common feature of optimal trajectories for the linear-search problem and variants is that the step size 
is a geometric sequence. For the star search, the step size increases by a constant factor of -;^^ at each 

iteration, and the overall competitive factor works out to be ( 1 + 2 /„^_^-,,n-i ) . Furthermore, it can be shown 
that under certain assumptions, any unbounded optimal search trajectory has to be a geometric sequence 
^lEIi see P] for details and citations. 

While these geometric trajectories are quite elegant from a mathematical point of view, there is a serious 
downside: As they "start" with an infinite sequence of infinitesimal steps, they are neither practical, nor is 
the necessary time realistic. (See Figure H) So far, the issue of the infinitesimal startup has been avoided, 
either implicitly or explicitly; e.g. [211 says "In order to avoid this problem we assume that a lower bound of 
one for the distance to the target t is known." It should be noted that |29l I23| have dealt with the "upper" 
part of the infinite sequence by assuming that an upper bound on the distance to the object is known in 
advance. 

In this paper, we study a clean and simple way to avoid the problems of geometric sequences without 
a first step, by assuming a constant turn cost d for changing direction. This assumption is natural and 
realistic, as any reasonable scenario incurs some such cost for turning. We describe optimal trajectories for 
this scenario; as it turns out, they are generalizations of the optimal trajectories for the linear-search problem 
without turn cost, and have the same asymptotic behavior as d ^ 0. The only previous work we are aware 
of that mentions turn cost in the context of the linear-search problem is |2ZI, which considers (Section 2.5, 
p.25f.) a kinetic model, where turning takes a certain amount of time for braking and accelerating. It is 
shown that assuming a lower bound on OPT, a competitive ratio of 9 is still best possible for large OPT. 
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An optimal search trajectory for the linear-search problem: A geometric sequence without a first 



("Thus, as the braking time is of no relevance for large n, we know that the competitive ratio must be at 
least 9 as well.") We go beyond this observation by cleanly quantifying the impact of turn cost on the overall 
search cost, and doing away with the assumption of a lower bound on OPT. 

1.3 Other Related Work 

Linear search problems occur in various contexts. See pQ for a study of rendezvous search on a line, where the 
objective of two players is to meet as fast as possible; this turns out to be a double linear-search problem. |25 
studies randomized strategies for the star search (which is also known as the "cow-path problem" , motivated 
by a cow searching for the nearest pasture.) See |^ for more on the star search, and [20] for parallel 
searching. 

Various types of search problems have been considered in a geometric (mostly two-dimensional) context. 
Here we only mention 9, 21, 28, 30', and the remarkable paper [221 that shows that online searching in a 
simple polygon can be performed with a competitive ratio of not more than 26.5. A very recent application 
in the context of robotics is described in |12[ [T^ , where a robot has to stop every time it takes a scan of its 
environment; just like in this paper, the overall objective is to minimize total time until the discovery of an 
object hidden behind a corner, and this time is the sum of travel time and a cost for special points. However, 
the resulting trajectories and mathematical tools turns out to be quite different from what is presented here. 

A good overview on search games can be found in the book [^, and the more recent book 0. 

Relatively little work has been done on geometric optimization problems with turn cost. The interested 
reader may find some discussion in the paper |3]. 



1.4 Duality for Linear Programming 

A standard tool for computing the values of two- player games is linear programming. In fact, studying such 
games was one of the origins of linear programming: An optimal strategy for one player can be interpreted 
as an optimal primal solution, while an optimal strategy for the second player corresponds to an optimal 
dual solution. (The reader unfamiliar with the basics of linear programming may turn to jl(J| for a good 
introduction.) 

For finite games, the following results are well known (as weak duality and complementary slackness) 
and elementary to prove: 



Proposition 1 (Weak duality, strong duality, complementary slackness) 

Let A be a Gnitc real matrix and let 6, c be vectors of appropriate dimensions. Let max c*a:, Ax < b,x > be 
a primal linear program (P), and let minb^y, y*A > c,y > be the corresponding dual linear program (D). 

Then weak duality holds: For any pair of feasible solutions, x' for (P) and y' for (D), we have c*x' < b*y'; 
if c*a;' = b*y' for any pair of feasible solutions, then x' is optimal for (P) and y' is optimal for (D). 

Furthermore, strong duality holds: If (P) is feasible and finitely solvable by x* , then there exists a dual 
feasible solution y* with c*a;* = &*?/*. 

For any such pair of optimal solutions, complementary slackness holds: If a dual variable yj is positive, 
then the corresponding primal constraint must hold with equality; if a primal constraint does not hold with 
equality, then the corresponding dual variable must be zero. Conversely, any pair of solutions satisfying 
complementary slackness is optimal. 

The paper [23j also uses linear programs for the analysis of the cow-path problem; in particular, it uses 
these tools for analyzing the scenario where there is a known limit on the distance to the object. Considering 
turn cost makes our problem different; moreover, we use a different perspective of dealing with the issue of 
infinitely many constraints by considering dual variables for establishing a lower bound. 

1.5 Our Results 

Motivated by the linear-search problem with turn cost, we achieve a number of results. 

• We establish duality results for certain types of infinite linear programs. As it turns out, this implies 
a verification method for the optimality of strategies. 

• We show that the linear-search problem in the presence of turn cost can be characterized by an infinite 
linear program. 

• Using CPLEX, we perform a computational study on the sequence of linear programs obtained by 
relaxing the infinite linear program to a linear subproblem with a finite number of constraints. 

• From the computational results, we derive an analytic proof of the optimal strategies of searcher and 
hider. As a consequence of duality, the resulting bounds are tight: an optimal strategy requires 90PT-|-2(i, 
and the optimal search strategy has step size Xi — d (2* — l) /2. 

• We also consider how the results vary if we allow the competitive ratio to increase at the benefit of 
decreasing the additive term. 

• We generalize the above results to the scenario of star search by showing that the searcher can guarantee 
finding a solution within time 
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• We show that for randomized strategies for searching on the line in the presence of turn cost, the same 
optimal competitive ratio q = 4.591121 . . . can be achieved as in the scenario without turn cost. 

The rest of this paper is organized as follows. In Section [2 we describe basic results on infinite linear 
programs. In Subsection l3 . II we discuss the start of the search and show that the presence of turn cost always 
forces the existence of a first step with step length bounded from below. In Subsection l3 . 2l we derive an infinite 
linear program for the value of the game. Subsection \'6.'6\ describes the results of a computational study; 
a clean analysis, with a mathematical proof of optimality of the derived strategies, is given in Section 13.41 
Subsection l3.5l discusses the tradeoff between the coefficients of OPT and d. Section0]describes the extension 
to star search. Section [S] gives a brief discussion on randomized strategies on the line. Some concluding 
thoughts are presented in Sectional 



2 Infinite Linear Programs 

At first glance, linear programming and duality are not easily applicable to the search games described 
above, as the games are unbounded. However, we demonstrate that it makes sense to consider infinite 
linear programs. As it turns out, we can still construct primal and dual solutions, and prove optimality by 
applying weak duality. For this purpose, we construct infinite linear programs as the limit of increasingly 
large finite linear programs, obtained by successively adding variables and constraints. In the limit, a solution 
is an infinite sequence, instead of a finite vector; the scalar product of two vectors turns into the series of 
component products. When studying convergence, it helps to think of each solution vector of a finite linear 
program as a sequence that has zeroes for all unused variables. 

Definition 2 (Infinite linear programs) 

Let c = (ci)igivi and b — {bj)j^^ be sequences of real numbers, and let A = (aij)ijg]N be a doubly indexed se- 
quence of real numbers. Analogously, let x = (xi)^^]^ and y = (2/j)jg]N be sequences of real variables. Denote 
by cC"), fe^''), xC"), yC') the vectors (ci . . . , Ck), (61 ... , Ck), {xi . . . , Xk), and {yi . . . , yu), respectively, and by 
A^'^' the matrix (aij)ijg{i....^fc}. Furthermore, we use the symbolic notation c*a; :— X^i^i <^i^i ^<^^ ^^^ scalar 
product of two sequences. Let {P'^'^^) be the kth subprogram, given by max c^'^^ x^''\ A^''^ x^''^ < b'^''\ x'^^'^ > 
0, and denote by (Z)^'^^) the corresponding kth dual linear program, given by minb^*^^ y^'^\y^'^'> A''^'^ > 
c('^)^y(*=) > 0. We say a sequence x = (xi)^^^ of nonnegative real numbers is a feasible solution for the 
infinite linear program given by A, b, c, if, for all j e N, the constraint X]i=i '^ij^i ^ bj holds; i.e., for all 
fc £ N, x'-*'-' is feasible for (Pk). An infinite linear program (P), denoted by ma.xc'^x,Ax < b,x > 0, is 
the problem of Rnding a feasible solution that maximizes c*x. A sequence y — {yj)je'M of nonnegative real 
numbers is an infinite dual solution, if for all i, ci < X^i^i ^vVj < ^^■ 

The following provides a way of establishing bounds for and optimality of feasible solutions for infinite 
linear programs. 

Tiieorem 3 (Weak duality for infinite LPs) 

Let raaxc^XjAx < b, x > be a an infinite linear program. Assume that the set J := {i G N | Ci 7^ 0} is 
Rnite, and that for any i G N, all but finitely many aij have the same sign. Let x be a feasible solution for 
(P), and let y be an infinite dual solution. Then weak duality applies: c*x < b*y. Moreover, if c*x = b^y, 
then X is optimal. 

Proof. By the above assumptions, we have 

00 

ex — > CjXj — > CiXi. 
i=l iel 

By assumption on y it follows from Xi > that 

00 00 00 00 

i^I j — 1 i^I j — 1 i—1 j — 1 

For any i, only finitely many of the Oy have a sign different from the others, so the converging series 
^ ■ j^ Xittijyj is absolutely convergent. Furthermore, only finitely many q can be negative, implying that all 






all but finitely many X]?li '^ijVj ^^"^ nonnegative. Thus, we may swap summations, getting 



00 00 00 00 



e*x < y\Ax) = X X ^i^-^oVi == X X ^'"^ ^J = {y*A)x < ^ b^y^ = 6*y, 

j=l i=l i=l j = l j = l 

as claimed. □ 



The following motivates our approach to solving infinite linear programs by considering the sequence 
of finite subproblems. Assuming convergence of the sequences of primal and dual solutions, we get strong 
duality: 

Theorem 4 (Strong duality for infinite LPs) 

Let m.a.xc*x,Ax < b,x > be a an inBnite linear program. Assume that the set /+ := {i S N | c^ > is 
Gnite. Let for all fc G N, (P'*^)) be feasible and bounded, and the sequence of primal optimal solutions be 
bounded; let x*^^' be a sequence of corresponding primal optimal solutions. For the corresponding sequence 
minfe'y'^'"'^?/^'^^ A^*^^ > c, j/^*^^ > of dual linear programs {Dk), let j/*(''') be a sequence of dual optimal 
solutions. Suppose that as k tends to infinity, x*^''' converges componentwise to x* and y*('^) converges 
componentwise to y* . Then x* is an optimal solution for the infinite linear program (P) . Moreover, strong 
duality holds, i.e., c**x* = b**y*. 

Proof. We start by establishing primal feasibility of x*: Suppose that inequality (j) was violated by x* , 
i.e., X]i=i OyXi > bj. As an = for £ > j, the first j components of x* involved in (j) form a point that has 
a positive distance from the set {z G R^ | J2i=i o-ijZi < bj}. As for all k > j, inequality (j) is part of (P*^'^^), 
it must be satisfied by x*^'^\ This contradicts the fact that x*'-'^^ converges towards x* . 

For k > max{i £ /+}, the sequence of objective values c^'^-' x*^'^'-' is monotonically decreasing, as for 
k < (., the feasible set for {P^^>) is a subset of the feasible set for {P^'^'). As the sequence of objective values 
is bounded, limfc^oo c'-'^-' x**-*^^ exists. For any k, we have c^'^-' x*'^^^ = b^''^ y^^^ by strong duality. Thus, we 
have 



c'x* - lim c('=)*x*('=) = lim b^^'^' y^'^^ = b'y*. 

k — >cxD k — >oo 

By Theorem 121 this implies optimality of x*. □ 

Finally, complementary slackness holds; this will turn out to be a useful tool for determining dual 
variables, and thus for proving optimality. 

Theorem 5 (Complementary slackness for infinite LPs) 

Let maxc*x,^x < 6, x > be a an infinite linear program. Assume that the set I :— {i ^ 'N \ a ^ 0} is 
finite, and that for any i G N, all but finitely many Uij have the same sign. Let x be a feasible solution for 
(P), and y be an infinite dual solution. Then x and y are optimal if and only if the following complementary 
slackness conditions hold: 

(a) For any i G N with X^jli Vj^ij > Ci, Xi — holds. 

(b) For any z G N with Xi > 0, YlfLi Vj^ij — ^i i^olds. 

(c) For any j G N with J2^i o-ij^i < bi, yj — holds. 

(d) For any :/ G N with yj > 0, J^ili '^ij^i — ^i holds. 

Proof. By assumptions, all involved series are absolutely convergent. Thus we get {y*A)x > c*x <t=> 
{y'^A — c)x > 0, and y*6 > y*{Ax) <^ y^{b — Ax) > 0. Now it is easy to check that y^b = c*x, iff the stated 
conditions hold. □ 

We believe that the above tools are useful and applicable in various game-theoretic scenarios, even when 
there is no clear idea of a possible optimal strategy. We demonstrate the practical applicability by giving 
the results of a computational study performed with CPLEX ^J, a commercially available software package 
for solving linear programs, and showing how these results enable us to give a tight (theoretical) analysis of 
the cost of an optimal search strategy in the presence of turn cost. It should be noted that in this paper, the 
numerical experiments are only a stepping stone towards finding optimal strategies: The idea is to identify 
closed-form limiting solutions; once those are found and verified by using duality, numerical accuracy is not 



an issue. That means that the numerical resuhs could be omitted without impeding the proof of optimality 
of the resulting strategies. However, our approach should also prove useful for other problems, even if no 
optimal closed-form strategy can be deduced from solving finite subsystems: In those cases, we can still give 
bounds on the possible performance of strategies. Only in those cases, issues of numerical stability come 
into play. 

3 Searching on the Line with Turn Cost 

3.1 The First Move and an Additive Term 

In the presence of a positive turn cost d, the hider can make it impossible for the searcher to achieve a 
competitive ratio, by simply placing the object arbitrarily close to the origin, on the side that is not picked 
first by the searcher. Clearly, this requires a minimum cost of d, regardless of OPT. Moreover, the searcher 
will be forced to make a second turn if she starts with a too small (or infinitesimal) first step. This increases 
the minimum cost. 

We show that the optimal competitive ratio, c, remains the same even if we add turn cost. Thus, the 
worst-case time to reach the target is c-OPT plus some additive term, denoted B, that we wish to minimize. 
Determining the minimum value of B is one of the main objectives of this paper. 

It is clear that even in the presence of a fixed additive term, the searcher will not be able to achieve 
any competitive ratio at all if she uses a large number of steps before first reaching a distance of d from the 
origin. In particular, it can easily be seen that she is forced to make a first step of length xi — Q{d). We 
will use this observation in the following subsections for a more careful analysis. 

3.2 An Infinite Linear Program 

Suppose that the searcher carries out a sequence of step lengths xi,X2, ■ ■ ■ from the origin, where Xi,X3, . . . 
are increasing distances to the right, while X2,a;4, . . . are increasing distances to the left. In the following, 
we denote these turn positions by pi = {—ly^^Xi. 

For a given sequence of step lengths Xi, the hider can choose the possible set of locations j/i = (—1)*+^ {xi + 
s) for an arbitrarily small e. If the object is placed at y„, the searcher will only encounter it after traveling a 
distance of (X]"=i ^a;^) + a;„ + e, and making n + 1 turns. Note that for arbitrarily small d, this approaches 
the linear-search problem, with a competitive ratio of 9. In order to guarantee this competitive ratio, and 
an additive cost of B, the corresponding search trajectories satisfy 

2xi + . . . + 2xi_2 + 3a;i_i +2xi+id + e < 9(xi_i +e) + B. 
As all Xi are bounded away from zero, and the above condition must hold for any e > 0, we conclude that 

2xi + 2a;2 + . . . + 2xi^2 + 3xi_i + 2xi + id < 9xi_i + B. 
or 

2xi + 2x2 + . . . + 2xi^2 — 6xi_i + 2xi + id < B. 
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1.0000 


0.0000 




















2 


1.2500 


0.1250 


0.0000 








0.7500 


0.2500 








3 


1.4166 


0.2083 


0.3333 


0.0000 






0.6666 


0.2500 


0.0833 






4 


1.5312 


0.2656 


0.5625 


0.6875 


0.0000 




0.0625 


0.2500 


0.0937 


0.0312 




5 


1.6125 


0.3062 


0.7250 


1.1750 


1.3000 


0.0000 


0.6000 


0.2500 


0.1000 


0.0375 


0.0125 


6 


1.6718 


0.3359 


0.8437 


1.5312 


2.2500 


2.3750 


0.5833 


0.2500 


0.1041 


0.0416 


0.0156 


7 


1.7165 


0.3582 


0.9330 


1.7991 


2.9642 


4.1607 


0.5714 


0.2500 


0.1071 


0.0446 


0.0178 


8 


1.7509 


0.3754 


1.0019 


2.0058 


3.5156 


5.5930 


0.5625 


0.2500 


0.1093 


0.0468 


0.0195 


9 


1.7782 


0.3891 


1.0563 


2.1692 


3.9130 


6.6284 


0.5555 


0.2500 


0.1111 


0.0486 


0.0208 


10 


1.8001 


0.4000 


1.1003 


2.3011 


4.3031 


7.5078 


0.5500 


0.2500 


0.1125 


0.0500 


0.0218 


20 


1.9000 


0.4500 


1.3000 


2.9000 


5.9000 


11.5000 


0.5250 


0.2500 


0.1187 


0.0562 


0.0265 


30 


1.9333 


0.4666 


1.3666 


3.1000 


6.4333 


12.8333 


0.5166 


0.2500 


0.1208 


0.0583 


0.0281 


40 


1.9500 


0.4750 


1.4000 


3.2000 


6.7000 


13.5000 


0.5125 


0.2500 


0.1218 


0.0593 


0.0289 


50 


1.9600 


0.4800 


1.4200 


3.2600 


6.8600 


13.9000 


0.5100 


0.2500 


0.1225 


0.0600 


0.0293 


100 


1.9800 


0.4900 


1.4600 


3.3800 


7.1800 


14.7000 


0.5050 


0.2500 


0.1237 


0.0612 


0.0303 


200 


1.9900 


0.4950 


1.4800 


3.4400 


7.3400 


15.1000 


0.5025 


0.2500 


0.1243 


0.0618 


0.0307 


400 


1.9950 


0.4975 


1.4900 


3.4700 


7.4200 


15.3000 


0.5012 


0.2500 


0.1245 


0.0621 


0.0310 



Table 1: Solutions for a number of linear subsystems. 



We thus get the following infinite linear program: 



min B 



2x1 




6x1 + 


2X2 


2x1 - 


6X2 + 2X3 


2x1 + 


2X2 - 6x3 



2x1 + 2x2 + 



+ 
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B 
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B 


Ad 
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id 
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B 
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B 
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0. 



(1) 



3.3 Solving the Sequence of Linear Programs 

Even with sophisticated software, it is impossible to solve an infinite linear program to optimality. However, 
for each n, the first n linear inequalities describe a relaxation of the overall program. Denote A — B/d, and 
let A„ be the optimal value when only considering the first n constraints. Then any A„ is a lower bound on 

(n) . (n) 

the overall A. Furthermore, the sequence of primal optimal values x^ and dual optimal values y^ should 
converge, if there is any hope for an overall solution. 

We have solved a number of these relaxations by using CPLEX 7.1. The computational results are shown 
in Table Q] Shown are the number of constraints that we used, the optimal value A„, the first five primal 
variables, and the first five dual variables. To allow numerical computation, d was normalized to 1. As each 
A„ is a valid lower bound, numbers were truncated, not rounded. 

The table illustrates several points: 

1. Even small subsystems may have "ugly" solutions, indicating a relatively fast increasing effort for 
trying to establish lower bounds by analyzing subsystems manually. 

2. Convergence is rather slow; in fact, it seems to be logarithmic, as doubling the size of the system 
appears to cut the remaining error in half. This and the tediousness of the solutions make it rather 
difficult to give an explicit closed formula for the objective values, which could be used for analyzing 
the limit. This justifies the use of powerful tools like CPLEX in order to get good estimates quickly. 

3. Actually closing the remaining gap in order to prove that the lower bound of 90PT+2(i is tight requires 
considering the whole infinite linear program. 



We will demonstrate in the following subsection how the latter point can be carried out analytically. 

3.4 Provably Optimal Strategies 

To establish optimal strategies for the infinite linear program, and thus a pair of optimal strategies, we start 
by describing a feasible dual solution that yields a lower bound of 2 for the objective value A. 

Consider yj — i^. We will show that with these dual multipliers, the linear combination of the first n 
coefRcients for any variable Xj tends to 0, as n approaches infinity. More precisely, taking a linear combination 
of all inequalities in J^l, with coefRcient yj used for inequality j, yields 



2 I IZ ^J - 8y2 Ui + 2 K] yj - 8^3 U2 + • ■ • + 2 K] y, - 8y,+2 U» + ■ • ■ + ^1^^^ ) ^ 




Using yj — ~, the involved series and coefficients do converge: The coefficient of Xi becomes 

-4r + E---f-4 + 2VlV 

Thus, this turns out to be 0. 

Similarly, the coefRcient of d becomes X]"=7 2!^ which tends to 2 as n grows. 

Finally, the coefficient of B on the right hand side of the inequality is the geometric series X]r=i ^' "which 
tends to 1. 

Therefore, the derived inequality simplifies to the lower bound 

2d< B. 

To see that 2d is also an upper bound, and thus an optimal solution for S, consider Xi = (2* — i)d. For 
this particular set, the jth inequality becomes 

l^2.Th.J ~8x,-i+jd<B, 

which simplifies to 

2d< B. 
Thus, the linear program becomes 



min A , . 

2 < A. ^ ' 

Trivially, this is solved by A — 2, implying that the given Xi and A = 2 do indeed provide a feasible 
solution with objective value 2. By duality of linear programming, this is optimal. 

It should be noted that the primal and dual solutions satisfy complementary slackness, as all constraints 
hold with equality. Note that our solution to the linear-search problem with turn cost achieves a competitive 
ratio of 9, which must be the optimal value because the time to find the target increases with d > 0. 

We summarize: 



Theorem 6 

In the presence of turn cost d for the hnear-search problem, the searcher can guarantee a solution within 
time 90PT+2d by choosing the search strategy Xi = (i(2* — l)/2. The additive term 2d is minimal subject 
to the optimal competitive ratio, 9. 

Note that the overall total cost spent on turning is about log2 OPT. 

3.5 Tradeoff between CoefRcients 

The term 2d is best possible if we want to maintain the best possible competitive factor of 9. It may be 
desirable to improve the former term, while allowing an increase in the latter. For any bound c > 9 on the 
competitive ratio, the best possible B can be computed by using our above approach: In the system ^, 
replace all coefficients —6 by 3 — c. Conversely, we can compute the best possible c for any B/d £ (1, 2]. The 
resulting tradeoff curve is shown in Figure [5] This curve was obtained experimentally using CPLEX. We 
have not yet characterized it analytically, though we expect that to be possible. It is not hard to see that 1 
is a lower bound for any B/d, and that the best possible B/d tends to 1 for c approaching infinity. 
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Figure 2: Tradeoff between competitive factor and turn cost. 



4 Star Search 



For the problem with no turn cost. Gal 'IT proved that the sequence of turning points corresponding to an 
optimal search trajectory has to be cyclic. In the following, we show how to generalize the above results to 
the problem of star search in the presence of turn cost. 

As before, we consider a sequence a;i,a;2, ... of steps that cycle through the m rays. Suppose we have 
a turn cost of di on a ray, and d2 at the origin; set d = di + d2. By picking a hiding spot just beyond 
one of the turning points, the hider can force the searcher to find the object only after making moves 
Xn, . . . , Xn+m-1 and returning to the ray of Xn, making a total oi (n + m — 1) turns. This takes a time of 

i) + {n + m — l)d + Xn instead of the optimal a;„. Without the presence of turn cost, it is well 



2j-^r'-^- 



known that the optimal competitive ratio is (1 + 2 



'(m-l)" 



= : 1 + 2M. When the hiding point is close to 
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the start, the searcher may only get to it when entering the last ray, so we get the condition 

(m-1) 
If the hiding point is just beyond the nth turning point, we get the condition 



[ 2 ^ X, I +(m- l)d< B. 



Cn+m-l \ 
2 ^ x^\ +{n + m-l)d + Xn< B + {l + 2M)xn, 



or 

/ n+771— 1 



2 Y^ x,\ +{n + m-l)d< B + 2Mxn- (n) 

for the additive term A, if it exists. For convenience, we refer to the dual variables corresponding to constraints 
(m- l),...,(n),... as y„_i, . . . , j/„, . . .. 

Again, finding a strategy xi,X2, ■ ■ ■ that minimizes B subject to the above constraints can be described 
as an infinite linear program. For to = 3, 4, 5, 6 and various n up to 1000, we solved the finite subprograms 
by using CPLEX. Despite some numerical difficulties, we were able to extrapolate the limits of the series by 
making use of the logarithmic convergence. We obtained the following solutions: 

and 

B^mi ( ^^ ) -l\d={M - m)d. 

Note that finding Xi is also possible without deriving a closed-form solution directly from CPLEX ex- 
periments: If yj > for all j £ N, complementary slackness (Theorem EJ requires that all constraints 
hold with equality. Then subtracting constraint {n + m — 1) from constraint (n -|- m) yields the recursion 
2xm-i+n + d = 2Mxn, which is satisfied by the above solution. 

Theorem 7 

In the presence of turn cost d for the star search problem on m rays, the searcher can guarantee a sohition 
within time 

1 + 2 , ^"; \ OPT + TO ((^^) "" - 1^ d 
(to-1)™-V y\m-lj J 

by choosing the search strategy 

This strategy is optimal. 

Proof. We show that this primal strategy and B satisfy all constraints of the linear program with 
equality: The left-hand side of inequality (n) is 

/n+m — 1 \ 



2 ^ Xi \ + {n + m - l)d. 
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Using q := -^^^ and substituting tlie values Xi — d{q'^ — l)/2, tliis simplifies to 

g"+™ - q , 
a. 

On the other hand, by substituting the above values, the right-hand side 

-B+ (2 



(m- l)™-\ 

becomes 

m (q™-! - 1) d + mg"-! (g" - 1) d 

or (using ni = —it) 

g"+™ - g , 

a. 

q-l 

Therefore, with B = m i I ^^^ ] — 1 j d, all constraints are satisfied with equality, regardless of n. 

It remains to be shown that the above solution is best possible. In principle, this can be done by 
figuring out explicit closed-form expressions for the dual variables, and using them to verify optimality 
(The interested reader may try this for to = 3, where the dual variables turn out to be yj = — — g^^^ ' ' for 
j > 771 — 1 = 2, i.e., the sequence 4/9, 4/27, 4/27, 20/243, 44/729,...) However, this explicit approach appears 
to be extremely tedious for any to > 3, and hopeless for general to. As we will see in the following, finding an 
explicit closed-form expression for dual variables is not necessary for a proof of optimality. Instead, we use 
complementary slackness to derive a recursive characterization of y, and verify that it satisfies all required 
conditions. 

As any solution xi, . . . describing a valid strategy must satisfy Xi > for all i > 1, we conclude by 
Theorem that all corresponding dual constraints must hold with equality; as c^ = for all Xi, this means 
that 

/ oo 

^'^yi I = 2Myi+m_i (z) 

must hold for all i G N, with yi = ... = ym-2 — for ease of notation. Noting that we are trying 
for a nonnegative y (and thus an absolutely convergent series '^j^^yj), subtracting this condition (i) for 
i = n > m — I from the condition for i = n + 1 yields 

yn+l — M{yn+m — J/n+m-l), 

i.e., the recursion 

1 

yn+ni yn+in—l 'l\7y'^' 

Because the cost coefficient cs of i? is — 1, we get the requirement X]5=m-i Vo ~ ^^ which implies y™ — 
■ ■ ■ = y2m-2 = 1/Af by conditions (1), . . . , (to — 1). Choosing y„i-i = rn/M , we get a well-defined sequence 
y. Using the initial condition y2m-2 — ^/M, the recursive condition implies yn+m = 57(1 — Y^^=m~i Vj)- 

Because of f| = ^"~,!.-"'i = (l-;^)"" € [1/3,1/2], the series Ej°lm-i 2/j = l™n^oo Ej=m-i yj does 
indeed tend to 1. (In fact, not only does yj^rn/Vj tend to m/M for large j, but the ratio yj/yj-i tends 
to (^^7^)-) For the given starting values, the sequence X]?=m-i Vj remains below 1, so the sequence yn+m 
remains nonnegative. 
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It remains to be shown that y^b — c*x, i.e., X^^^m-i ^Vj = -^^ ~ ^^i. This follows from 

oo 2m— 2 oo 

Y. ■'>y^ = Y. ^y^^ Y ^y^ 

j=m — l j—m—1 j— 2m— 1 

2m— 2 oo 

Y ^y^ + XI (•? + rn)yj+rn 

j—m — 1 j—m — 1 

2m— 2 oo ^ 

= Y ^yi^ Y iJ + m)iyj+m~i - —Vj) 

j—m~l j— 771 — 1 

2m— 3 oo oo 

= (2to - 2)2/2m-2 + Y -^^J + Y iJ + '^ " ^)yj+rn-l + Y Vj+-^-'^ 
j—m — 1 J—m — 1 j—m — 1 

oo ^ oo 

El -^-^ m 

j—m—1 j—m—1 

(-> (-, oo / z, / / 1 — O \ '.JKj ^ 

Ira — 2 v-^ / \-^ \ \-^ 1 . m 



oo / 2m — 3 \ oc ^ 

-m — 1 \ j—7n — l J j—m — 1 



W'j 



3 = 



hence 



^ jVj = 2m - 2 + (M -m- {m- 2)) - m = Af - to, 
as claimed. □ 

5 Randomized Strategies 

Consider the search on the hne with turn cost. It is natural to consider randomized strategies for both 
players: The particular choice of search strategy or hiding position depends on the outcome of a random 
event that is not known in advance. It is known that the optimal competitive ratio q ^ I + a for online 
searching on the line without turn cost is given by the solution of the equation satisfying jii — a, or 
q = 4.591121 . . .; see |2|, pp. 129/130. Clearly, the optimal coefficient qt of OPT in the presence of turn cost 
must satisfy qt > q. To see that there is indeed a strategy that achieves qt ~ q, consider a modified scenario 
without turn cost as follows: 

1. The searcher only locates the hider after passing the hider by a length of at least d/2. 

2. When discovering the hider, the cost is the distance traveled, minus d/2. 

Then the resulting calculations from 2 translate precisely to the scenario with turn cost. Using the 
same turning points Xi > d/2, we get a mixed strategy that assures a cost of q{OPT + d/2) — d/2 = 
qOPT + d{q — l)/2. The additive constant can be improved, as the terms below d/2 arc not used. We 
conclude: 

Theorem 8 

For randomized strategies in the presence of turn cost, the optimal coefBcient of OPT is the same as without 
turn cost. 

Again it is possible to consider the optimal coefficient of the turn-cost factor, and also consider the tradeoff 
between both coefficients. We leave this to future research. 
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6 Conclusions 

In this paper we have considered the Hnear-search problem in the presence of turn cost. We have shown that 
this extends the well-studied case without turn cost, and established a performance guarantee of 90PT-|-2d. 
We also extended or results to the general star search on m rays (also known as the cow-path problem) , and 
showed that this problem can also be resolved by using an infinite sequence of linear programs. 

We believe that our methods and results can be easily extended to various other problems that have been 
studied; in particular, it should not be too hard to give explicit estimates for the lower-order terms, which 
show up if the distance OPT to the hidden object is known to be bounded by some D: This only requires 
giving an explicit estimate for the solutions of subsystems of size n = Q{\ogD). 

Just like the cow-path problem extends to various geometric scenarios, we expect that there are also 
many other problems for which the cost of changing the search direction plays an important role. 
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